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Abstract. We study a continuous time stochastic process on strings made of 
two types of particles, whose dynamics mimics the behaviour of microtubules 
in a living cell; namely, the strings evolve via a competition between (local) 
growth/shrinking as well as (global) hydrolysis processes. We give a complete 
characterization of the phase diagram of the model, and derive several criteria 
of the transient and recurrent regimes for the underlying stochastic process. 



1. Introduction 

Microtubules are important structural components of the cytoskeleton, which 
play a vital role in many processes in a living cell. Their unique ability of rapid 
growth and even more rapid shrinking (often called dynamical instability) is ex- 
ploited by the nature to segregate chromosomes during cell division, and as such 
microtubules have been the subject of intensive study. At the same time, the high 
complexity of the involved processes turns experimental study of microtubules into 
a challenging task, with many key questions in the area remaining unanswered. 

In a recent paper [1] the authors suggested a simplified stochastic model of mi- 
crotubule growth aimed at deriving the dynamical instability from the interplay 
of a small number of parameters (The actual behaviour of microtubules is much 
more complex, see e.g. review [7] and references there). Mathematically, the model 
represents microtubules as long polymers made from two types of monomers, © 
and G (guanosin triphosphate (GTP+) and guanosin diphosphate (GDP - ) tubu- 
lin complexes), subject to several stochastic transformations occurring with fixed 
rates, namely: growth, i.e., attachment of © monomers to the active end (with the 
rate depending on the type of the extremal monomer), hydrolysis, i.e., irreversible 
transformation of a © monomer into a © monomer (independently of the state of all 
other monomers composing the microtubule), and depolymerisation/shrinking, i.e., 
spontaneous departure of the hydrolyscd extreme monomer (for a formal definition, 
see Sect. Il.ll below). The authors described analytically the limiting behaviour of 
the model in several particular cases but had to rely upon numerical simulations in 
"the more biologically relevant case of intermediate parameter values" pQ . 

Our aim here is to describe the phase diagram of this model, in particular, 
to give several equivalent characterisations of the phase boundary, the set in the 
parameter space separating the region of the unbounded growth of microtubules 
from that of the "compact phase" , where the average microtubule length remains 
bounded. According to one of our main results (for a complete list and rigorous 
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statements, see Sect. 11.21 below), for every point in the parameter space (i.e., a 
collection of fixed rates) there is a well defined value of velocity of the position 
of microtubule's active end, and it is the zero-velocity set in the parameter space 
which separates the regions of unbounded growth (positive velocity) from that of 
"compact phase" (negative velocity). 

1.1. The model. Following |Tj, we think of microtubules m as of long polymers 
consisting of © and monomers, m — . . . to 2 toito , where £ {©, ©} for all k > 
0, with the "extreme" monomer too located at the active end of the microtubule. 
Initially all monomers are in the state, and the time evolution of the microtubule 
(formally described below) guarantees that with probability one at every moment 
of time the microtubule contains at most a finite number of © monomers; it is 
thus convenient to describe the current state of a microtubule at time t in terms of 
the position x t of the extreme monomer mo and the head (or the populated zone, 
PQ) w t of the microtubule, defined as the shortest word TO& . . . TOiTOo such that all 
other monomers to„, n > k 7 are in the © state. Since attachment of new monomers 
occurs at the active end of a microtubule, every non-empty head w t spans between 
the active end of the microtubule and its left-most © monomer. 

Let {©,©} be a two-symbol alphabet, and let W = U/c>o{ffi,©} denote the 
collection of all possible finite words, including the empty one. We call a head any 
word belonging to the set 



so that every non-empty head w can be written as a finite word Wk ■ ■ - Wq for some 
integer k > with its left-most monomer being in the © state, Wk — © (Here and 
below, if w' — w', . . . Wq and w" = {y" . . . w'q are two finite words in W, we write 
w'w" for the concatenated word w' k . . . w' w" ■ ■ ■ vj'q of k + I + 2 symbols). It is 
convenient to decompose the set W of all finite heads into a disjoint union 

(1.1) W = W+ U WL , where W+ = {w = w k . . . w £ W : w = ©} . 

In this decomposition the heads w £ W+ correspond to microtubules whose active 
monomer too is in the © state, whereas the set of heads W_ is associated with 
those microtubules for which too = ©; in particular, initially we have to^ = © for 
all k > 0, i.e., the head is empty and thus £ W_. Of course, every finite word 
w £ W corresponds to a unique head w — (w^ £ W obtained by removing all its 
© monomers to the left of the left-most © monomer in w; it is convenient to think 
of ( • ) : W — > W as a projection operator. 

Similarly, for integer to > 0, I > let [•]£* : W -> {©, ©} m+1 be the projection 
operator such that 

(1.2) W = Wk---W H> w= [w]f =w m ...w 0) 

where Wj — wg+j for j £ {0, . . . , to}, and we assume that the word w is extended 
with © monomers on the left if necessary, i.e., w 3 ■ — © if £ + j > k for j under 
consideration. If I = 0, we shall use a simplified notation [«;] m for the word 
consisting of the to + 1 right-most monomers in w, again extended on the left as 
necessary. 

Our main object here is a continuous-time Markov process 



W= {0} U { 



w — ©u) with w £ W} , 



(1.3) 



y t = (x t ,w t ), t>0 
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taking values in y = 7L x W, where Xt G Z is the position at time t > of the 
right-most monomer wo of the head w t € W. We shall assume that initially the 
microtubule consists of an empty head located at the origin, 

(1.4) Vo = (so,t»o) = (O,0), 

and that the transitions of y t are described in terms of fixed positive constants A+ , 
A~ and \x as follows: 

Attachment:: a © monomer attaches to the right end of the microtubule, 

(x, w) i-» (x + 1, w®) , 

at rate A+ if w G W + and rate A - if w G W_ ; of course, if w = G W_ , 
the head u;© should be understood as (wffi) = ©. 
Detachment:: if w G W_, i.e., w = rcsp. «; = w'Q with some ti/ G 
W \ {0}, the microtubule shrinks at rate /U, 

(2, 0) 1 ^ (a; — 1, 0) rcsp. (x, to'©) i->- (x — 1, ti;') . 

Conversion:: for a non-empty head it> = Wfe . . . wq e W, let J TO denote the 
list of positions of all © monomers in w, J w = {j > : Wj = ©}; then 
every Wj with j e J TO hydrolyses, = © i-> 0, at rate 1, independently of 
all other Wj, j G J w . In other words, if w is any word obtained from w by 
converting one of its © monomers into the © state, then at rate 1, 

(x,w) 1 y (x, (w)) , 

where transformations into different resulting words w are independent. 
Notice that if the left- most © monomer Wk in w hydrolyses, the resulting 
word w starts with ©, so that in this case the new head (w) is shorter than 
w and might even become empty. 

In our analysis of the main microtubule process (y t )t>o we shall rely upon two 
auxiliary processes approximating y t . 

Let = f < fi < . . . be the moments of consecutive returns of the Markov 
process {y t )t>o to states with empty head, 

(1.5) y e = y ft = (x e ,0), £>0. 

Clearly, the discrete time Markov chain (yi) e>0 can be identified with the process 
(xe)e>o, where x = 0. Put 9g = ft — fg-i, £ > 0. As the differences 

(xt - Xi-i,6e) = (xf t - Xf e _^,n - fe-i) 

are mutually independent and have the same distribution, the process {xt)e>o is a 
discrete time random walk on Z with i.i.d. increments. 

Our second auxiliary process is a "finite-state version" of the process (y t )t>o- 
For a fixed integer m > 0, let [ • ] m : W — >• {©,©} m+1 be the projection operator 
defined above. We then put 

(1-6) y t = (x™,w™) = y" 1 = f [y t ] m = (x t , [w t ] m ) , 

and equip the process y t with jumps (and rates) inherited from the process y t : 
then the conversion move for y t is the same as for y t , whereas the attachment 
move should be understood as 

(x,w) ^ (x + 1, [w®]" 1 ) , 



4 



O. HRYNIV AND M. MENSHIKOV 



and the detachment move becomes 

(x,0) >->• (x- 1,0) or (x,we) >->• (x - 1, [Qw] m ) , 

if w contains at least one © monomer (in the "finite-state" situation here and 
below, denotes the word of length m+ 1 made of monomers only). As a result, 
for every fixed m > the process {y t )t>o = (yt™)t>o is a continuous-time Markov 
chain on a "finite" strip Z x {©, g}'™ +1 . The transience and recurrence properties 
of such chains are similar to those of discrete-time chains on strips, see e.g. [4j 
Chap. 3]. 

1.2. Results. We now are ready to state our main results. 
Theorem 1.1. The random vectors 

(1.7) (Aix,Aif) = (xi -xi-i,n -n-i) , l>l, 

share a common distribution with finite exponential moments in a neighbourhood of 
the origin. Consequently, the discrete time random walk (xi)i>o in Z, generated by 
the i.i.d. steps A;i, satishes all classical limiting results including the (Strong) Law 
of Large Numbers, the Central Limit Theorem and the Large Deviation Principle. 

Since the increments of the sequence (fi)i>o have exponential moments, the em- 
bedded random walk (i;)/>o captures the long-time behaviour of the main process 
(Ut)t>o- In what follows we shall often say that the process {y t )t>o is transient to- 
wards +oo (resp. — oo) if the random walk (i;);>o has the corresponding property. 

Corollary 1.2. The velocity v of the process (xt)t>o, defined as the almost sure 
limit 

def ,. x t 
v = lim — , 

f— >oo t 

satisfies v — Ex\/Et\. In particular, Exi > corresponds to transience of x t 
towards +oo and Ex\ < corresponds to transience of Xt towards —oo. 

Remark 1.2.1. In a more realistic from the biological point of view case of x t 
restricted to the half-line Z + = {0, 1,2,...}, the condition Ex\ > corresponds to 
unbounded growth (with speed v > 0), whereas the condition Eii < corresponds 
to the "compact phase" of positive recurrence. 

Remark 1.2.2. Existence of exponential moments for the vectors (|1.7[) allows for a 
fast numerical estimation of Ei 1; and thus provides a constructive way of describing 
the phase boundary for the Markov process (y t ) t >o- 

We now give another characterisation of the transient regime towards +oo. 

Theorem 1.3. If A~ > fj, + A + , the Markov process (y t )t>o is transient to- 
wards +oo. Alternatively, if A~ < fj, + A + , the process {y t )t>o JS transient to- 
wards +oo if and only if for some m > the m-projected process (y t '")t>o is 
transient towards +oo. 

Remark 1.3.1. The transience and recurrence properties of the "finite-strip" pro- 
cess (y t m )t>o can be easily described through the solution Tz m to a finite system 
of linear equations, see (|3.2I) below. This, together with the fact that the Markov 
process (y t )t>o is well approximated by (y[ n )t>o for m large enough, for precise 
results see Section \3{ provides a constructive way of describing the +oo transient 
regime of (y t )t>o- 
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We now give an alternative description of the "compact phase" . Let the Markov 
process (y t )t>o start from the empty-head initial condition (|1.4[) . Assuming that 
the first event results in arrival of a © monomer at position 1, we define its arrival 

time via £oi = f minji > : Xt = l}, and, on the event when £oi is finite, the 

departure time Cio of this monomer, Cio = f minjt > Coi : Xt — 0}. Then the 
difference 

(1.8) Ta ^ Cio - Coi > 

describes the lifetime of the © monomer at position 1. Notice, that the lifetime 
of every monomer attached to the microtubule after the initial time t = does 
not depend on the configuration of the microtubule at the moment of arrival and 
therefore has the same distribution as T\ . 

Of course, T\ is almost surely finite, and we formally put T\ — +oo if either of 
the times Coij Cio is infinite. At the same time, we obviously have that ETi > 0. 

In what follows we shall see that it is the finiteness of ETi, which is central to 
describing the "compact phase"; moreover, if ETi < oo, then the Laplace transform 

tp(s) = f Ee _sTl of Ti is finite for some s < 0, equivalently, T\ has finite exponential 
moments in a neighbourhood of the origin: 

Theorem 1.4. The Markov process {y t )t>o is transient towards — oo if and only 
if ETi < oo, equivalently, y(s) is finite in a neighbourhood of the origin. 

The average lifetime ETi can be computed from tp(s) in the usual way, 

ETi = - lim -j-tp(s) , 
sio ds 

and the latter has the following property. 

Lemma 1.5. The Laplace transform ip(s) = Ee~ sTl of the lifetime T\ satisfies the 
following functional equation: for all s > 0, 

n n s , s (l + A+y>(s))(// + A-y>(s)) A+ (Qx + s)<p{s) - /x) 

(L9) ^ S)= (l + A + + ^ + A-+.s) + (1 + A+ + S )(M + A-+^ (S + 1) - 

Remark 1.5.1. In addition to being potentially useful for numerical evaluation of 
<p{s), Lemma [Ol can be used to studying properties of various lifetimes, see Sec£.[H 
below. 

The rest of the paper is devoted to the proofs of the above results. In Sect. [2] 
we shall use the intrinsic renewal structure of (y t )t>o and the regularity property 
of birth and death processes from Sect. [A] to derive Theorem II .11 and Corollarv ll.2l 
Then, in Sect. [3] we shall investigate stochastic monotonicity properties of the pro- 
cesses (y™)t>o and use them to verify the finite-strip approximation result, The- 
orem 11.31 Finally, in Sect. HJ we prove Lemma 11.51 Theorem 11.41 and establish 
a similar characterisation of the transience towards +oo, based upon the Large 
Deviation estimate from Sect. [EJ 

2. Renewal structure 

In this section we shall exploit the intrinsic renewal property of the Markov 
process (y t )t>o related to the consecutive moments fi,l>0, when its head becomes 
empty, Wf t = 0. By the strong Markov property, for every fixed I > 0, the process 
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Vft+t = ( x fi+t, i/)f,+i) i t >0, has the same law as (y t )t>o if started from the initial 
state (xf n 0); in addition, this law does not depend on the behaviour of (yjtefo.fi)- 
It is thus sufficient to study (y t )t>o over a single cycle interval [0, fi). 

2.1. A single cycle behaviour. Fix arbitrary positive rates A + , A - , and /i, and 

denote A = max(A + , A~) > 0. Our aim here is to relate the Markov process (y t )t>o, 
whose dynamics is governed by the rates A + , \~, and /i, to the continuous-time 
birth-and-death process (Y t ) t>Q with birth rate A and death rate 1 (per individual), 
see App. [X] In fact, we shall couple them in such a way that the total number of 
© monomers in w t = wit), 

( 2 -f) Iktll = J2^{ Wj ( t )=®} 

j>0 

is bounded above by the total number of individuals Y t in the birth-and-death 
process; in particular, the moment f\ of the first disappearance of the head of the 
process y t shall occur no later than the first return of Yt to the origin. 

Formal construction. We couple the Markov process (y t )t>o with rates (A + , A - , /i, 1) 
described above and the birth-and-death process (Yt) t>0 with death rate 1 and birth 
rate A = max(A + , A - ), see App. [3] in such a way that the inequality < \\w t \\ < Y t 
is preserved for all times t > 0. 

To start, we shall assume that A~ > A + so that A = A~ (the necessary changes 
needed in the case A~ < A + shall be commented on below), and then denote 

(2.2) A = f min(A", A+) > 0, 5X = | A+ - A" | > . 

Two cases need to be considered separately. 

Case I: Let y t = (x t ,w t ) with Wt S WL, and Yt = n + \\w t \\ with n > 0. We 
define four independent exponentially distributed random variables (1 ~ Exp(A), 
C 2 ~ Exp(/x), C3 ~ Exp(||itf t ||), C4 ~ Exp(n) and put C = min(Ci, C2, C3, C4) ■ Then 
the first transition occurs at time t + £ and is given by 

• if £ = £1, then Yt+<; —Y t + l and a © monomer attaches to the microtubule, 
i.e., y t+( = {x t + l,w') with w' = w t ®; 

• if C = C21 then Y t +Q = Y t and the extremal G monomer wo(t) leaves the 
microtubule (i.e., for w t = we have y t +c ~ ( x t ~ 1>^)) ano - m f ne case 
w t e W_ \ {0} we have y t +( = i x t — l, w ') with w'j = w j+i{t) f° r au 
3 > 0); 

• if C = C3> then Y t +Q — Y t — 1 and one © monomer in w t hydrolyses (uni- 
formly at random); 

• if C = &) then Y t+( = Y t - 1 and y t+Q = y t . 

By using the well-known properties of exponential random variables, it is im- 
mediate to verify that jumps of both processes (y t )t>o an d (^t)t>o have correct 
distributions. We also notice that the last transition above can only happen if 
n > 0; as a result, the key inequality |jt(; t+ ^|| < Y t +^ is preserved after the jump. 

Case II: Let y t = (xt,w t ) with w t £ W+ and let Y t — n + \\w t \\ with n > 0. We 
now consider four independent exponential random variables fi ~ Exp(Ao), C2 ~ 
Exp(5A), C3 ~ Exp(||«j t ||), C4 ~ Exp(n) (recall ([221)), and put ( = min(Ci, C2, Cs, C*)- 
Then the first transition occurs at time t + C and is given by 
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• if £ = £1 , then Yt+Q = Yt + 1 and a © monomer attaches to the microtubule, 
i.e., y t+( - = (x t + l,w') with w' = Wt®; 

• if C = (2, then Y t+C = Y t + 1 and y t+( = y t ; 

• if C = (3, then = It — 1 and one © monomer in io t hydrolyses (uni- 
formly at random); 

• if C = C*) then Y t+C = Y t - 1 and y t+c = y t . 

Again, it is straightforward to check that the transitions above provide a correct 
coupling. 

By using an appropriate case at every step, we construct a correct coupling of 
two processes Y t and y t for all t > in the region A~ > A + . The construction 
for A~ < A + is similar with the only difference that the simultaneous moves with 
rate A = A+, i.e., | • • • ffi) n- | • • • © ©) and Y t+ Q =Y t + l, occur when w (t) = © 
(Case II), whereas a pair of moves with rates Ao and SX (recall lines C = Ci an d 
C = C2 hi Case II above) occurs when wo(t) = ©, i.e., in Case I. 

Observe that in the coupling described above, every jump of the microtubule 
process (y t )t>o involving © monomers (attachment or hydrolysis) corresponds to 
an appropriate move (up or down) in the birth-and-death process (Y t ) t>0 . We shall 
use this coupling below to study the microtubule process (y t )t>o- 

2.2. Proof of Theorem 11.11 and Corollary 11.21 To prove Theorem II. li fix 
positive jump rates A + , A~ and \i as above and consider the Markov process (y t )t>o 
starting from the initial condition (|1.4p . y = (0, 0). Recall that fi > is the first 
moment of time when the process y t enters a state with empty head, y fl = (§1, 0). 
Our aim is to show that the expectation 

is finite for some z > 1 and s > 0. By using the Markov property at the end of the 
initial holding time rj\ ~ Exp(A~ + /i), we deduce the relation 

(2.3) s) = , A ' +M \-^— z- 1 + z s) 

A + /i — SLA + fl A + [I 

where $1(2:, s) is defined as $o(z,s) but with the initial condition y' = (1,©), i.e., 
with the head w consisting of a single © monomer at position x = 1. It thus suffices 
to show that $1(2, s) is finite for some z > 1 and s > 0. 

To this end, we shall use the construction from Sect. 12.11 to couple the micro- 
tubule process (yjt^^j and the birth-and-death process (Y t ) t > m with birth rate 
A = max(A + ,A~), death rate 1 and the initial condition Y ni = 1. Let t% be the 
hitting time and let ki be the total number of jumps until the process (y t ) t > m 
starting at y m — (1,©) hits an empty head state (xi,0). Similarly, write tq for 
the hitting time and Ko for the total number of jumps until the birth-and-death 
process Y t hits the origin. Finiteness of $i(z,s) shall follow from monotonicity of 
this coupling and the results of App. |XJ 

Let (J be the total number of © monomers attached to the microtubule during 
the time interval [0, fi). Since by the time f\ all these © monomers have hydrolysed 
and some of the resulting © monomers might have detached from the microtubule, 
we obviously have 2jJ < kq + 1 and therefore 

< 3(t < ^(k + 1) , -l<5i<tt<^7^. 
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It now follows from the inequality T\ < tq and Proposition I A. 1 1 that 



z^ e STl 


<VzE 


z K /2 e ST 









provided \fi < z and s < s, for some z > 1 and s > 0. This estimate together with 
the decomposition (|2.3p implies the first claim of Theorem 11.11 The other results 
for the random walk x n now follow in a standard way ([5j [2]). 

Notice that the argument above also proves the following result. 

Corollary 2.1. Let t\ be the hitting time and let K\ be the total number of jumps 
until the process {yt)t>rn with initial state y Jli = (1,®) hits an empty head state 
(xi, 0). Then there exist z > 1 and s > such that Ei [z Kl e STl ] < oo everywhere 
in the region z < z and s < s. 

Of course, Corollary 11.21 the Strong Law of Large Numbers for the renewal 
scheme with increments (|1.7|) . follows immediately from Theorem ll.il (see, e.g., [3j 

Sect. 5.2]). In addition, the estimate max \xt— xq\ < Ki+1 and the corollary above 

te[o,fi) 

imply the corresponding concentration result, namely sharp exponential estimates 
for the probabilities of the events | ^ — | > e with small fixed e > and large t. 



3. Finite approximations 

By Thcorcm ll.il the process w t is an irreducible continuous time positive recur- 
rent Markov chain in W. If tt is its unique stationary distribution, denote 

7r_|_ = 7r(w + ) = 2_. n ( w ) i 7r - = tt(W-) = 2_, n ( w )i 

wew + wgW- 

i.e., 7r_|_ (resp. 7r_) is the probability that the right-most monomer in w is a 
® monomer (resp., a monomer), recall (|1.1|) . 

Similarly, for every fixed m > the projected chain w t = [w t ] m has a unique 
stationary distribution 7r m , for which we define 

7T + = 77 I 10 ®) ) 7T_ = 2^ ^ \ w &) ■ 

ioe{e,e} m TOe{ffi,e} m 
We then have the following result. 

Proposition 3.1. Denote v + = A + > and t>_ = A~ — /j,. Then, almost surely, 
(3.1) lim — iEt = 7r_i_ v+ + 7r_ v_ , lim —xT 1 — 7T+ w+ + 7?™ W- . 

i — ^ oo £ i— >-oo t 

As a result, if V- > v + , then the process Xt is transient towards +oo and for every 
m > the process x™ is transient towards +00. On the other hand, if v_ < v + , 
then x t is transient towards +00 iff for all sufficiently large m > the process x™ 
is transient towards +00. 

Of course, if the velocity in the RHS of (|3.1j) does not vanish, then xt is tran- 
sient towards +00 or —00 depending on the sign of this velocity. We shall deduce 
Proposition 13.11 below by first showing that 7?™ < 7T™ +1 < 7r_|_ for all m > and 
then proving that in fact 7r_|_ = limm-^oo 7r™. 
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Remark 3.1.1. Let Q m be the generator of the finite-state Markov chain Wt. 
By irreducibility, its stationary distribution tt" 1 is the only probability distribution 
satisfying the finite-dimensional system of equations 

(3.2) % m Q m = . 

The above proposition implies that if for some m > the solution to this system 
makes the RHS of (|3.ip positive, then both processes (y t )t>o and (y™)t>o are tran- 
sient towards +oo. This gives another numerical method of establishing transience 
towards +oo for the process (y t )t>o- 



Remark 3.1.2. If m = 0, the stationary distribution 7z m becomes 

n° = (t?° ,7r°_) = (A-/(l + A"), 1/(1 + A-)) 
and therefore the velocity vq = ir ^ v + + 7r°_ u_ is non-negative iff 

(3.3) n < \~ (1 + A+) . 

It has been argued in [TJ Sect. V.B], that the RHS of (|3.3[) provides an asymptot- 
ically correct approximation to the "phase boundary" v = in the limit of small 
A + and A - . It is interesting to notice that according to Lemma \3.2\ below, every 
point in the phase space for which the equality in (|3.3|) holds, belongs to the region 
of positive velocity v for the process y t ; i.e., where y t is transient towards +oo. 

We start by noticing that the explicit expressions (|3.1j) for the limiting velocity 
of the process Xt in Proposition 13.11 follow directly from the Ergodic theorem for 
continuous time Markov chains. Indeed, for a fixed m > 0, consider the Markov 
chain y t = y™ with the initial conditions y = (0, 0). Decomposing the difference 
x" 1 = x^ 1 — xfi 1 into a sum of individual increments and rearranging, gives 

(3.4) = fc ™,»' W i x v/ - x ™] . 

where k w w > (t) is the total number of transitions w i— > w' for w t during the time 
interval [0,i]. Of course, 

if w' = [w®] m , 

if w' = eHT 1 , 

else , 

so it is sufficient to concentrate on the transitions which change the position of 
the microtubule active end. It is not difficult to deduce that the ratios k w w > (t) jt 
converge to definite limits as t —> oo. For example, fix w G W"\ w' — [w®] m and 
write k w (t) for the total number of visits to w for u}™ during the time interval 
[0, t]. If T w denotes the first return time to state w, then the Ergodic Theorem and 
the Strong Law of Large Numbers imply the almost sure convergence 

k w (t) ; 1 fcwM ; A+ 

t ~* E W T W k w (t) ~* ||to||+A+ 

Consequently, [SJ Chap. 3] 

kw,w'(t) A + 




as t — > oo . 



(\\w\\+X+)E w T u 



= 7f,„A H 
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almost surely, as t — > oo, where tt — tt" 1 stands for the unique stationary distribu- 
tion of the Markov chain w t . Repeating the same argument for all other pairs of 
states w, w' in (|3.4I) and re-summing, we deduce the second equality in (|3.1[) . A 
similar argument implies the velocity formula for the process (y t )t>o- 
Our main result here is the following observation: 

Lemma 3.2. Let positive rates X + , A~ and fj, be fixed. Then for all integer m > 
we have 7r™ < 7?™ +1 . Moreover, lim m _ >00 7r™ = 7r_|_. 

Remark 3.2.1. If one interprets the projection operator [•]'" as an enforced 
conversion © i— > Q outside a finite region, the statement of the lemma justifies 
the heuristics that "a less strict enforcement policy increases the chances of seeing 
© monomers at the right end of microtubules". 

The remainder of this section is devoted to the proof of this lemma. We first 
establish a non-strict monotonicity of 7? , in m via a coupling argument in Sect. l3.il 
and then deduce the strict monotonicity of 7r™ from a suitable probabilistic bound 
in Sect. 13.21 Finally, Sect. 13.31 is devoted to a proof of the convergence claim of 
Lemma 13.21 

3.1. Comparison of finite chains. Fix positive rates A + , A~ and fj, and an integer 
to > 0, and consider two Markov chains 

Vt = (x t ,w t ) = y t and y t = (x t ,w t ) = y t 

with initial conditions y' = (0,0), y ' = (0,0); in the finite size setting here and 
below, refers to a string of an appropriate length consisting of © monomers only. 

We now construct a coupling of the processes y' t and y" in such a way that for 
all i > the following monotonicity property holds: 

(3.5) w' t <w'{, i.e., y k w' k (t)=® => <(t)=©. 

Of course, in view of the intrinsic renewal structure and the strong Markov property, 
it is sufficient to construct a coupling on a single cycle of the Markov chain y", i.e., 
on the time interval between two consecutive visits by w" to the state 0. Again, 
we shall proceed by defining a coupling of a single step at a time. 

Recall that we use [• ]f to denote the projection operator [ • ]™ : W — > {©, ©} m+ 
from p.2[) . and that \\w t \\ is the total number of © monomers in w t , recall (|2.1I) . 
In our construction below we shall separately consider four different cases. 

Case I: Let at time t > we have the following configuration: 

y' t = (x' t ,w') , y'l = «, w") , w' -< w" € W_ , 

so that both w' and w" end with a © monomer (in particular, we might have 
w' = or w' = w" = 0). Denote 

Jo = {j > : w> = w'! = ©} , Ji d = f {j > : w'j = Q , w'J = ©} , 

so that \\w'\\ = \J \, \\w"\\ = | Jo U Ji\ = \J \ + \ Ji\. With n = \J \ and m = \ Ji| 
we consider four independent exponential random variables £i ~ Exp(A^), (2 ~ 
Exp(n ), C3 ~ Exp(ni), C4 ~ Exp(^i) and define ( = min(Ci, C2, Ca, (4)- Then the 
next transition occurs at time t + C and is given by 

• if C = £1, then a © monomer simultaneously attaches to both processes, ie, 
y' t+c = (x' t + 1, [w'®] m ) and y'^ = « + 1, [w"®}™* 1 ); 
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• if C = C2 j then two © monomers w'j and w'J , with j G Jq selected uniformly 
at random, hydrolyse simultaneously, i.e., w'j(t+Q — © and w'J(t+Q = ©, 
whereas all other monomers in w' and w" do not change; as a result, we 
have x' t+( - = x' t and x" +( - = x"\ 

• if £ = £3, then the © monomer with with j G Ji selected uniformly at 
random, hydrolyses, whereas all other monomers in w' and w" as well as 
^-components of both y-processes do not change; 

• if £ = £4, then the right-most © monomer detaches from both microtubules, 
in other words, y' t+c = (x' t - 1, [u>']f ) and y'J +c = « - 1, [w" 

Case II: Let at time t>0we have the following configuration: 

y' t = (x' t ,w'), y'l = {x'l,w"), w'<w", w'eW+, 

so that both w' and w" end with a ©-polymer. Defining index sets Jo and J\ and 
their cardinalities no = \Jq\ and ni = | Ji| as in Case I, we consider three independent 
exponential random variables (1 ~ Exp(A + ), C2 ~ Exp(n ), C3 ~ Exp(ni) and define 
C = min(Ci, £2, Cs)- Then the next transition occurs at time t + ( and coincides 
with the corresponding ^-transition in Case I. 

Our construction in the remaining case shall depend on which of the "attach- 
ment" parameters A is bigger; we thus use the notations from (|2.2p , 

A = min(A-,A+) > 0, 5\ = \ A+ - A~ | > , 
and consider two sub-cases separately. 

Case Ilia: Let A~ > A + and let at time t > we have the following configuration: 

y' t = (x' t ,w'), y" = (x",w"), w'<w", w' G W_ , w"eW+. 

Define index sets Jo and J\ and their cardinalities no = \Jo\ and n\ = | J\ \ as above, 
consider five independent exponential random variables, (1 ~ Exp(u), ( 2 ~ Exp(no), 
C 3 ~ Exp(ni), C4 ~ Exp(Ao), Cs ~ Exp((5A) and put C = min(Ci, C2, C3, C4, Cs)- Then 
the next transition occurs at time t + £ and is given by 

• if £ = (1, then the right-most © monomer detaches from the head w' , i.e., 
y' t+c = (x' t -l,[ w< }?) and y^C = Wt 5 

• if C = C2 , then two © monomers w'j and w'J , with j G Jo selected uniformly 
at random, hydrolyse simultaneously, whereas all other monomers in w' 
and w" as well as ^-components of both y-processes do not change; 

• if C = (3, then a © monomer w'J with with j G Ji selected uniformly at 
random, hydrolyses, whereas all other monomers in w' and w" as well as 
x-components of both y-processes do not change; 

• if C = £4, then a © monomer simultaneously attaches to both processes, ie, 
y' t+c = (x' t + f, [w'®] m ) and y'/ +c = «' + L [^"ffi] m+1 ); 

• if £ = £5, then a © monomer attaches to the head w' t only, in other words, 
y' t+c = (x' t + 1, [w'O ] m ) and y'/ +c - y'{ , 

Case 1Mb: If A - < A + and the departing configuration is the same as in Case Ilia, 
we use the same construction as there with the only difference that for C = Cs ~ 
Exp(<5A), a © monomer attaches to y" only, i.e., y" +( j = {x" + 1, [w"(&] m+1 ) but 

y't+c = y'f 
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Lemma 3.3. Let positive rates A + , A , \x and an integer m > be fixed. Consider 
the truncated processes 

I (I /\ def // / // f/\ def ^ m +l 

Vt = K x u w t) = Vt > Vt = \ x t » w t ) = Vt 
starting from the "empty" initial conditions y' Q = (0, 0), y' Q ' — (0, 0). 

ff A - > A + , then for every fixed t > in the coupling above we either have 
w' t = w'l or there exists a unique jo > such that w" g = ©, w'j g = and 

w' j (t)=w'!(t) y j<j , w' j (t)=w'j(t) = e v j>j . 

Remark 3.3.1. In other words, Lemma \3.3\ states that in the region A~ > A + 
for every t > the words Qw™ and either coincide at all positions or have 

exactly one discrepancy at the position of the left-most © monomer in w 7 t n+ . 

Proof. It is straightforward to verify that the claim of the lemma holds until the 
first visit to the state (w' t ,w") = (0,©). Then in the cases ( — (3 or ( — ( 5 of 
Case Ilia we get w' t +£ = w t+( ( an d coincides with or © respectively) and in the 
cases C = Ci or C = C4 the discrepancy remains of the same type (at a single place); 
clearly n = implies that C = C2 does not happen with probability one. The result 
now follows from a straightforward induction. □ 

It remains to study the case A + > A~. 

Lemma 3.4. For hxcd integer m > and positive rates A + , A~ and /Lt, consider 
truncated processes (y' t )t>o and (y")t>o as defined in Lemma [Q1 

If A + > A - , then for every fixed t > wehaveQw' t -< w' t ', recall <\3.5\i . Moreover, 
if these heads do not coincide (Qw' t ^ w'l), then there exists j\ > jo > such that 

w 'io (*) = w 'n ( f ) = e ' W 'L (*) = < ( f ) = ®> and 

w' j (t)=w'!(t) V i<io, 

«>;•(*) = e v j>io, i<(t) = e v j>ji. 

Remark 3.4.1. In other words, Lemma [3.41 states that in the region A + > A~ , 
for every fixed t > the words Qw' t and w'l either coincide, or there exists jo > 
such that both strings Qw' t and w'l coincide to the right of jo and w'j (t) = © for 
al/ j > jo- Notice that in contrast to the case A~ > A + , the discrepancy between 
Ow' t and w'l can now spread out over an interval containing several consecutive 
left-most © monomers in w'l . 

Proof. As in the case A~ > A + , there is at most one discrepancy between Qw' t 
and w'l over the time interval until the first visit to the state (w' t ,w'l) = (0,©); 
moreover, it can only happen at the position of the left-most © monomer in w'l . 

We next observe that the joint dynamics described above guarantees that if at a 
moment t > the right-most monomers in w' t and w'l coincide, i.e., w' (t) — w'^if), 
then both processes y' t and y'l shall run in parallel with all pairs of © monomers 
attached to w' and w" at times t + s > t evolving identically till at least the first 
of the following events happens: 

• the pair (w' (t), w' ' (t)) simultaneously leaves the process (y' t ,y'l); 

• the number of monomers to the right of the initial pair reaches m; at that 
moment t + s we cither have Qw' t+S = w' t ' +s (if this pair has simultaneously 
hydrolysed by time t + s) or w' t+s = [w' t ' +s ] m and w'/ +1 s = ffl. 
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In other words, the discrepancy between w' t and w' t ' does not grow when jo > 
and it can only grow when jo — 0, equivalently, when w" € W+ and w' t = 0; notice 
however, that this discrepancy can shorten or disappear at all due to simultaneous 
spontaneous hydrolysis of © monomers in both heads or due to the "enforced" 
hydrolysis on the left end of the heads. A straightforward induction now finishes 
the proof of the lemma. □ 

As a result, the joint dynamics described above gives the ordering (13. 5ft . w' t -< w" 
for all t > 0, so that the Ergodic Theorem implies 7r™ < 7r™ +1 . Our next step is 
to establish the strict inequality in the last inequality. 

3.2. Strict monotonicity of 7r™. To show the strict monotonicity of 7r™ as a 
function of to, we prove here that in addition to the ordering property p.5[) . the 
coupling constructed in the previous section guarantees that the long-time density 
7Tq'™ +1 of the moments when w' t g W_ and € W+ is strictly positive. Then 
Lemma 13.21 shall follow directly from the standard Ergodic theorem. 
Our argument below shall be based upon the following three facts: 

Fact I: Let T m+1 be the time between the consecutive returns by w™ +1 to the 
initial state 0, and let denote the number of returns by )t>o 

to by time t. A straightforward generalization of the coupling in Sect. 12. ll 
above shows that T m+1 is stochastically smaller than fi, which by Theo- 
rem [Ll] has exponential moments in a neighbourhood of the origin. There- 
fore, ET" l+1 < Eri < oo and the strong Markov property together with 
the LDP implies that the probability of the complement A\ to the event 
A\ == f {ui : UJ n+1 ^ 2EI7} decays exponentially fast as t —> 00. 

Fact II: Consider now the joint dynamics of (y" l )t>o and (y" l+1 )t>o start- 
ing from the "empty head" initial state y™ — (0,0), = (0,0) as 
described above. Denote by Pq^ the probability of the event 

{a; : for some s < f m+1 , w™ = , w^ +1 = ®} . 

By a "single-trajectory" argument we easily deduce that Pq^ > 0. 

We next write T™ +1 for the fcth return of the pair (w™, w™ +1 ) t >o to the 
state (0, 0), and use jj^ e = ft e ® (k) to denote the total number of returns to 
the state (0, ®) up to time T™ +1 by the pair of processes (w™, w™ +1 ) t >o- 
Using the strong Markov property together with the Large Deviation Prin- 
ciple for binomial random variables we deduce that the probability of the 

complement A\ to the event A\ = f {lu : jj^ e > ^^/c} decays exponen- 
tially fast as k — > 00. 
Fact III: By the construction in Sect. 13.11 above, the holding time t)™^ of the 
process (w™, w™ +1 )t>o at the state (0,®) has exponential distribution 
with parameter v = 1 + ji + max(A + , A~) > 0. Let p u > be the prob- 
ability of the event {w : t)qq > 1/f}. Consider now L separate visits by 
(tD™, w;™ +1 )t>o to the state (0,©) and denote by jj^ the number of those 
of them whose holding times f)™^ are larger than 1/v. By the standard 

LDP we deduce that the probability of the complement A\ to the event 
A\ = f {u> : f L > PfL} decays exponentially fast as L — > 00. 
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We now deduce the strict monotonicity of Sr? in Lcmma l3~2"1 to this end, consider 
the events 



a 



It follows from the discussion above that the probabilities P(S t 1 ), P(Bf \ ), 
and P ( Bf \ B\ J decay exponentially fast as t — » oo (here and below we write .4. 
for the complement of the event A). On the event B\ H B^ D B% the total time 
spent at the state (0,©) by the trajectories (w™ ,w™ + )o< s <t is bounded below 
by PvPqq t/ (16 v Efi) for all i large enough, f > t\. On the other hand, by the 
elementary inequality 

p(AnBnc) <p(a) + p(s|A) + p(c ? |b) 

and the estimates above, the probability of the complement to B\ nB ( 2 nB ( 3 satisfies 
p = P{B}nB?nB?) < P(Bj) + P(Bl \b}) + p(b? I B\) < \ 

provided t is large enough, i > £2- 

We finally deduce that for all t > max(ii,t2) we have 

^m+l -^-m -^m.m+l def 1 . 1 / ~ tl , 

" 16 v Efi V w " 32 1/ En 



This finishes the proof of the strict monotonicity of tt + in Lemma 13.21 

3.3. Convergence of 7?™. We first observe that an obvious modification of the 

construction in Sect. 13. ll provides a coupling of the processes y' t = (x' t ,w' t ) = f y™ 
and y'l = y t . Consequently, the Ergodic theorem implies that 

1 ft 

so it remains to bound above the last integral. We shall do this by using an argument 
similar to that in Sect. 13.21 

Let an integer m > be fixed. As in (|1.5j) , we shall use fi to denote the moment 
of ^th return to the state by the process Wt (by monotonicity of the coupling 
we then also have w™ = 0). We shall say that the discrepancy event occurs during 
£th cycle, if for some t € [f^_i,re) we have (w t ,w™) € W+ x {0}, ie, at time t 
the right-most monomer of w t is a © monomer, whereas w™ is empty. Of course, 
this is only possible if at some s € [7j_i,t) we had w s — w m+ i ...wiWq with 
Wm+i = w o = © an( l during [s, i) all monomers to the right of u> m +i detached from 
w s with w m -\-\ still being in the © state. 

By independence and memoryless property of the hydrolysis process for individ- 
ual monomers, the probability of discrepancy event during any given cycle drops 
sharply as m increases. Indeed, by the observation above, the discrepancy event 
cannot occur for cycles with less than 3(m + 1) + 2 = 3m + 5 transitions, whereas 
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by Corollary [2J] the probability of the event {ki > 3m + 5} is exponentially small 
as a function of m. 

Let t > be fixed; write T>™ for the collection of all indices I such that a 
discrepancy event occurs during [ft-i,ft ). If £o = max{£ : ft < i}, then 

d f /"* 

(3.6) J m (t) = / l{ii™eW-)l{^,ew + }*< Y"] (fie - ff_i) + (i - T£ ) . 



Our aim here is to prove the following result. 



Lemma 3.5. For every e > there exists m > 7arge enough such that for some 
A > and a > one has P(j m {t) > et) < Ae~ at uniformly in t>0. 

In view of the trivial bound J m (£) < t 1 the Borel-Cantelli lemma implies that 
for every fixed e > we have, with probability one, 

< 7r_|_ — 7r" 1 < limsup -J m {t) < 2e 

if only m > m £ . It thus remains to verify the claim of the lemma. 

Let an arbitrary e > be fixed. We shall use the following three facts: 

Fact I: Denote tt t = min {£ > : ft > t). Since the differences fi+i— fg, I > 0, 
are iid random variables with the same distribution as fi, Theorem 11.11 
implies that for every £ > there exist positive A-y and a\ such that 

- — > (t ) < A x e- ait for all f > . 
Efi / 

Fact II: For I = 1, . . . , jj t , let Kq be the total number of transitions of the jump 
chain during £th cycle, ie, for t € [ fi—i, fi ). By the discussion above, if the 
discrepancy event occurs during £th cycle, we necessarily have Rq > 3m + 5. 
Denote 

it 

— / j K ^{k e >3m+5} ■ 
1=1 

By Corollary IB. 21 for every C2 > small enough there exist ( 2 <E (0, (2), 
m > 0, A2 > and a 2 > such that 

P(^ n i (Ca*>C2*)) < ^ 2 e~ a2t for alU > . 

Fact III: During every cycle, each holding time is exponentially distributed 
with parameter not smaller than v = min(l,A~ + /u) > 0. As a result, 
duration of every single cycle of k jumps is stochastically dominated by the 
sum of k iid Exp(i/) random variables. 

Notice also that if m ~ Exp(v), j = 1, . . . , k, are iid random variables 
then, by the classical LDP, for every £ 3 > there exist A 3 > and a 3 > 
such that for all k > 0, 



P (E^ (- + ^) <^e~ 



0>3 K 



Combining these observations, we deduce that J m {t) from (|3.6[) is stochastically 
j- 



smaller than J3y=i rjj, with ~ Exp(^), j > 1, being iid random variables. Taking 
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C2 = evjZ and (3 = l/(2v), we deduce that for some m > 0, A > and a > 0, 



3=1 

ie, the result of Lemma \3 . 5 1 holds . Consequently, lim 7r™ = 7r_|_, as claimed. 



4. Properties of the lifetimes 

4.1. Proof of Lemma ll.5l By the Markov property, the lifetime T® of the extreme 
ffi monomer at the origin can be rewritten as (recall (|1.8p ) 

T ffl =min{t>O:i/ t = (-l,0)|y o = (O,e)}. 
Similarly, the lifetime T e of the extreme monomer satisfies 

T e = minjt > : y t = (-1,0) | y = (0,0)} . 



For s > 0, consider the Laplace transforms of these times, <p®(s) = f Ee sT ® and 

Suppose the process y t starts from y = (0,0). After an exponential holding 
time ?7o ~ Exp(/i + A - ), the extreme monomer either departs from the system or 
a © monomer attaches to it, thus increasing the total lifetime by T^+Tq, where Tq 
and Tq are independent and have the same distributions as and Tq respectively. 
As a result, the strong Markov property implies 



(4.1) 



<p B {a) = E(e-^) 



A" 



(j, + A /x + A 



-Ve(«) <^e( s ) 



Similarly, after a holding time 771 ~ Exp(l + A + ), the initial configuration y = 
(0, ffi) either becomes (0, 0) or (1, ffiffi). In the second case, after a time ~ Tq the 
process y t arrives either in (0, 0) or in (0, ©), depending on whether the © monomer 
initially at the origin hydrolyses by time or not. Consequently, if X®e denotes 
the lifetime of the head ©ffi, we get 



rp/i 
-L a: 



-T" 



+ (l-e T ®)^e(s) 



and as a result, 

E e - sT e® = ^ ( s + l)( (/3ffi (s) - <p e (s)) + <p & (s)ip e (s) . 
Combining this with the first-step decomposition at time 771 , 



we obtain 
(4.2) tp e (a) 



Ee -^i 
1 + A+ 



1 



1 + A- 



:<Pe(s) 



A^ 



1 + A^ 



(p e (s) + A+(/? e (s + l)(<p e (s) - <pe(s)) + A + <^ e (sV e (s) 
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Finally, recalling that for 77 ~ Exp(p) we have Ee sr> = pj (p + s), we rewrite (|4.ip 
and dO) as 



(/i + A + s) y> e (s) = p + A ^©(s)<^e(s) 

(1 + A+ + s) ip m (s) = (1 + A + 99 e (s))^ e (s) + A+(^ e (s) - y> e (s))<£ e (s + 1) . 

Getting rid of ^e(s), we deduce that </?©(s) satisfies (|1.9I) . This finishes the proof 
of Lemma 11.51 



Differentiating (|4.1[) . equivalently, the first equation in the last display, we im- 
mediately deduce the following fact. 

Corollary 4.1. For all positive p, A + and A~, we have 1 + pET e = A~ ET ffi ; in 
particular, both ETq and EX® are finite or infinite simultaneously. 

Remark 4.1.1. Our argument above implies that the lifetime T® stochastically 
dominates T e , i.e., P(T e > t) > P(T e > t) for all t > 0. 

4.2. Proof of Theorem 11.41 Our aim here is to verify the following fact. 

Proposition 4.2. Let T ffi be the lifetime of the extreme © monomer, and let v 
be the velocity of the process Xt as described in Corollarv \1.2l Then v < if and 
only if ET® < 00. Moreover, if v < 0, then T® has exponential moments in a 
neighbourhood of the origin. 



Of course, Theorem 11.41 follows directly from Corollary 1 1 . 2 1 and Proposition [O] 

Proof. Let first ET ffi < 00 and let the process y t — (xt,w t ), t > 0, start from 
y = (0, 0). To deduce that v < 0, consider a sequence of stopping times So = 0, 
Sk = minji > Sk-i ■ Xt = — fc}, k > 1. Of course, {S^} is just a renewal sequence 
whose increments Sk — Sk-i are independent and share the same distribution as Tq. 

~ def 

Consider the sub-walk Xk = xs h of the random walk xt corresponding to the 



consecutive moments when the head w t becomes empty, recall (jl.5j) . As in Sect. l2.2| 
the strong law of large numbers implies that, with probability one, as fc — > 00, 
we have Xk/Sk — > — 1/ETq. Combining this with Corollary 11.21 we deduce that 
v = — gyr^ < 0, and observe that by Corollary 14.11 the condition ET e < 00 is 
equivalent to ET ffi < 00. 

We next assume that v < and deduce existence of exponential moments for Tq 
in a neighbourhood of the origin. To this end, it is sufficient to verify the following 
property: 

For every v < there exist positive constants K , A, and a such that 
(4.3) P(T e > Kn) < Ae- an for all n > 1 . 

Indeed, for every a € (0,a/K) the bound (|4.3I) implies that 



3C 



Aae 



aK 



Ee QT » < ae aK ]T e aKn P(T e > Kn) < '"" aK _ a < 00 . 

n=0 e 

It thus remains to derive property (|4.3[) . We begin by considering the random 
walk y l — (xi,wi) starting from y = (0,0) as in (|1.5[) . By Theorem 11.11 and 
Corollary II. 2\ for every Ci > the large deviation probability P(x n > (v + £i)n) 
is exponentially small as n — > 00. In particular, for £i = \v\/2 there exist positive 
constants A\ and a\ such that P(x n > vn/2)< A\t 
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Assume that the process y t starts from y = (0,©). Consider the collection t z *, 
I > 0, of consecutive moments of time when y t enters states with empty head, i.e., 
w t — 0. Clearly, all variables Tq > 0, r* — Tq , r| — t*, . . . , are independent and 
have exponential moments in a neighbourhood of the origin; moreover, all but the 
first one share the common distribution with the stopping time T\ from (|1.5|) . We 
denote L n = max{Z > : r ; * < ifn} (where L„ = — oo if Tq > Kn), and introduce 
the event B\ = {i„ > f^"-}- By the usual Large Deviation Principle estimate 
(similar to Fact I in Sect. 13.3) ) . the complement B\ of is exponentially small: for 
every K > there exist positive constants A2 and 02 such that 

P(W n ) = p(L n < <.4 2 e- Q2 " 

for all 71 > 1. To simplify the notations, we put K = Efi/2 and assume that the 
constants A2 and 0,2 are compatible with this choice. On the event B n we now have 
L n > n, equivalently, r* < Kn = nEri/2. 

Let Xq = x T * be the position of the end of the microtubule at the first moment 
Tq > when the head w t vanishes (recall that Wq — 0). By Corollary 12.11 Xq has 
exponential moments in a neighbourhood of the origin, so that for every £3 > 
there exist positive A3 and 03 such that P(xq > (371) < A^,e~ a3n for all n > 1. 

We finally observe that on the event B\ we have {T ffi > Kn} C {x T , > 0}, so 
that using the Markov property at the moment Tg , we obtain 

P(x K > 0) = ^2 P { x rS = k ) P ( X K ~ x r$ >-k). 

fc>0 

Now, taking £ = min((i, C3), we can bound the RHS above by 

Cn 

p (^r* = k) P(x K - x r5 > -Cn) + P(x TS > (n) < A 4 e~ a * n , 

fc=0 

where A4 = A\ + A3 > and 04 = min(ai, 03) > 0. 
Putting all these estimates together, we get 

P(T ffi > Kn) < P(Bj) + P(T ffi > Kn \ B*) < P(Bj) + P(x K > 0) < Ae~ an 

for all n > 1, where A = A 2 + A4 > and a = min(a2,a4) > 0. This finishes our 
proof of (I4.3j) and that of Proposition ^. 21 □ 

Appendix A. Regularity of birth and death processes 

For fixed A > and /i > 0, consider a continuous time birth and death process 
Yt, t > 0, whose birth rate is A and death rate per individual is fi. In other words, 
Yt is a Markov process on Z + = {0, 1,2,...}, such that every jump from state k > 
to k + 1 has rate A, and jumps from k > to k — 1 have rate kn. Let To be the 
hitting time and let kq be the total number of jumps until the Markov chain Y t hits 
the origin. For z > and s£l consider the function 

Vv(z, S ) ^ E m [z K ° e -°], 

where as usual E m stands for the conditional expectation corresponding to the 
initial state Xq = m > 0. Our aim here is to verify the following result: 

Proposition A.l. Let an integer M satisfy M/j, > A. Then there exists z > 1 and 
s > such that max m= i i ... j M V'ml 2 ; s ) JS Gnite provided z < z and s < s. 
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Our proof of Proposition IA.ll in Sect. IA.3I shall be based upon two auxiliary 
results for finite state Markov chains (Sect. lA.f [) and random walks with negative 
drift (Sect. ED . 

A.l. Finite state Markov chains. For a fixed integer M > 1 put 

(A.l) 5 M = {1,2,...,M}, dS M = {0,M + l}, 

and let strictly positive numbers p m , q m , p m with m € Sm satisfy p m + q m = 1 
for all m £ Sm ■ Let Xt be the continuous time random walk on Sm = Sm U 8Sm 
whose generator Q — (Qij) i;J ^L has the following entries: 

' ' PmPm , i = m, j = m + 1 , 
Qtj = { qmpm , i = m, j = m - 1 , meS M , 
p m , i = m, j = m, 

and Qij = for all other i, j € Sm- In other words, Xt is a continuous time 
Markov chain on Sm with absorbing boundary dSj\i, such that upon arrival at 
state m € Sm the chain waits a random time £ m ~ Exp(p TO ) and afterwards jumps 
to m + 1 or m— 1 with probabilities p m and q m respectively. For b € 8Sm, let rfc be 
the hitting time and let Kb be the total number of steps until the chain Xt reaches 
state b. For real s and non- negative z, consider the functions 

<p° m (z,a) = E m [^°e-°l {T0<TM+l} ], 

(A.2) 

<f% +1 {z,8) * E m [z™+V™ +1 1 {TM+1<T0} ] , 

where as before E m (-) denotes the conditional expectation corresponding to the 
initial state Xq = m 6 Sm- Clearly, the quantities 

<p° m (l,0) = P m (r < t m +i) and 0) = P ro (r M+1 < r ) 

are both positive and add up to 1. Our aim here is to verify the following claim: 
Lemma A.2. There exist Zq > 1 and so > such that for \z\ < z and s < s , 
max \^ m (z,s),^ +1 (z,s)} < 1. 

Proof. We start by observing that for £ ~ Exp(p) and s < p the exponential moment 
Ee s ^ of £ satisfies Ee s ^ — p/{p — s) with the RHS being a decreasing function of 
p > 0. This implies that every holding time £ m satisfies 

be ^ m < — < oo if only s < p = mxnp m > I) . 

p — s m 

Next, for every fixed trajectory X t with k jumps, where k < min(K , km+i), its 
time duration is a sum of independent holding times at all visited states, so that 
the exponential moment of the total time duration of this trajectory is bounded 
above by p k / (p — s) k . Consequently, for every m € Sm 



",(*,•) < E,J(^) K °1 , ^ + \z,s) < E„J(^) 
L\p — sJ i l\p — sJ 



We now observe that in view of the estimate (cf. [SJ Lemma 10.11]) 
minP m (/t < M) > p = f (mm(p m ,q m j) > 



20 



O. HRYNIV AND M. MENSHIKOV 



the stopping time Ko has exponential tails, max m P m («o > nM\ < (1 — p) n ; since 
a similar estimate holds for Km+i, we deduce that max m 
is finite for some z > 1. Therefore, the estimate 

(A.3) max{^° m (z, S ),^f +1 (z, S )} < oo 

holds for all s < s' and \z\ < z' with s' > and z' <E (1, z) satisfying the condition 
pz'/(p— s') < z, equivalently, s' < p(l — z' jz\. Since all functions in the LHS of 
(|A.3|) are continuous for z and s in the region under consideration, and 

max((^(l,0),^f +1 (l,0)) = max(p m (T < r M +i), Pmfrju+i < r )J < 1 , 

the claim of the lemma follows. □ 

A. 2. Random walks with negative drift. For fixed A > and v > 0, let X t be 

the continuous-time homogeneous random walk on the half-line Z + = |0, 1,2,.. .} 
with absorption at the origin, whose jumps from state k > to k + 1 have rate A 
and those from k > to k — 1 have rate v. Let tq be the hitting time and let kq 
be the total number of jumps until the Markov chain X t hits the origin. For z > 
and set consider the functions 

(A.4) i> m {z,s) = E m [z K °e ST0 ] , m e N. 

Our aim here is to verify the following claim: 
Lemma A.3. Let v > A; if s' > and z' > 1 are such that 
(A.5) s' + 2(z'-1)v / a7< (V^- VA) 2 , 

then ipi( z > s) < oo for all z < z' and s < s'. 

Remark A.3.1. Notice that if v > A (i.e., AT t has negative drift), then for all 
m E N we have P m (ro < oo) = 1, and the lemma implies that ipi(z,s) \ 1 as 
z \ 1 and s \ 0. 

Our proof below is a straightforward adaptation of the standard argument for the 
discrete-time walks (see, eg., (6j Sect. 1.4]). We notice, however, that an alternative 
proof of Lemma lA.31 can be obtained by computing ip m {z, s) explicitly. Namely, by 
conditioning on the jump chain, we deduce (similarly to the argument in Sect. IA.2j) 

so it remains to observe that the last expectation is finite iff 4A^z 2 < (A + v — 
s) 2 (missing details behind the last two steps and the explicit expression for the 
generating function can be found in the classical monograph Sect. 14.4]). 

Proof. Applying the Markov property at the moment of the first jump out of the 
initial state 1, we get 

A + v f A v \ 

ipi{z,s) = z— 1 — — ip 2 {z, s) + — — . 

X + v — s\X + v A + v / 

On the other hand, the strong Markov property implies that ip m {z,s) = ["01(2, s)] m , 
for all to e N, so that ^li 2 : 8 ) is given by the smallest positive solution ip to the 
quadratic equation Xip 2 + v = atp with a = (A + v — s)j ' z. Such a solution exists 
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and is finite iff a 2 > AXv, cquivalcntly, if A + v — s > 2zVXv', as z > 0, the latter 
condition coincides with (|A.5[) . □ 

A. 3. Proof of Proposition IA.1L Our argument is based upon Lemmata IA.2I 
and I A. 31 as well as on the following fact. 

Lemma A. 4. Let Y t , t > 0, be the continuous time birth and death process with 
intensities A > and /z > 0, as described above. Fix an integer M > 1 such that 
Mfx > A and use f and k to denote the hitting time and the total number of steps 
until the process Yt hits state M. Then there exist real numbers £ > 1 and s > 
such that the generating function iPm(z,s) = f Em+i [z K e sr ] is finite for all s < s 
and z < z. 

Proof. Let X t , t > 0, be the continuous time simple random walk on Z with upwards 
rate A and downwards rate v = M\i > A. Coupling X t and Y t starting from the 
common state Xo = Yq = M + 1 in a monotone way (e.g., by using the Harris 
construction), we get V'm^, s) < ipi(z, s) , where tpi(-,-) is determined as in (|A.4|) 
for the random walk X t . The result now follows from Lemma IA.3I □ 

We turn now to the proof of Proposition IA.1I Let an integer M be as in 
Lemma IA.41 namely, let M satisfy the condition M/i > A > 0. We also fix an 
initial state m € Sm , recall (|A.1|) . It is convenient to re-sum the parts of the 
trajectories of Y t connecting states M + l and M, thus transforming the birth-and- 
death process (Y t )t>o into a continuous-time finite-state Markov chain with the 
state space Sm (recall (|A.ljl ). We shall split all trajectories contributing to 

^ m (z,s) = E m [z K °e s ^} 

into groups with an integer £ > specifying the number of transitions from 
state M + l e 3Sm to state M £ Sm before the trajectory hits the absorbing state 
e dS Ml see Fig.Q] 




Figure 1. Three groups of trajectories: Bo - trajectories hitting 
state without visiting state M' = M+l; B x - trajectories visiting 
state M' exactly once before hitting state 0; B' x - trajectories 
visiting state M' more than once. 

Of course, on B we have E m [2: Ko e ST °lB ] = <Pm( z > s ) (recall (|A.2| ). with the 
RHS being finite in the region specified by Lemma [A. 2 1 Otherwise, the trajectory 
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in question visits state M + 1 at least once and thus both stopping times ti and ui , 

ti d = min{i > : Y t = M + 1} , ui d = minju > ti : Y u = M} 
are well defined. By the strong Markov property, 

Ei [z K °e s ^l Bl ] = ^ I+1 (z, s)$ M (z, s)<p° M (z, s) . 
Similarly, defining stopping times tg, ug, £ > 1, via 

^ = minjt > : Y t = M + 1} , u e = mm{u > t t : Y u = M} , 
we deduce that for £ > 1 

E m [z K «e ST0 l-B e ] = <p% +1 (z,s)$ M (z,s) 
As a result, 

£>0 

+ Y,V™ +1 {z,s)$m{z,s) 
Of \ i ^'(^ s)^ M (z, s)(f° M (z, s) 

provided the last expression is finite. 

Finally, the product s) iPm(z, s) is continuous in the region 

\z\ < z = f min(zo, z) , s < s = f min(so, s) , 
where by Lemmata IA. 21 and IA. 31 we have z > 1 and s > 0. Since 

p£ +1 (l,0)# M (l,0) < Pm(t m +i < t ) < 1, 
the claim of the proposition follows by continuity. 

Appendix B. Long jumps density estimate for a class of random walks 

Our aim here is to derive a simple estimate for random walks whose jumps have 
exponential moments in a neighbourhood of the origin. This observation is at the 
heart of our argument in Sect. 13.31 but is also of independent interest. Of course, 
the statement and the proof below can be generalized to continuous distributions. 

Let Xj, j > 1, be a sequence of iid random variables with values in N = {1, 2, . . . }, 
whose common distribution has finite exponential moments in a neighbourhood of 
the origin, i.e., E[s x ] < oo for some s > 1. For a fixed K € N, we think of Xi, . . . , 

Xk as jumps of a random walk in Z+, and for A > put = f J2f=i ^j^{Xj>A], 
i.e., Sk is the total length of jumps Xj, 1 < j < AT, longer than A. We then have 
the following result. 

Lemma B.l. For every e > there exist Ao > 0, Kq > and a > such that the 
inequality P(S$ > eK) < e~ aK holds for all A > A Q and K > K . 

In view of the a priori estimate S% > A^. =1 I{Xj>A}) the claim of the lemma 
and the standard LDP for Binomial random variables with parameters K and 
PA — P(X > A) imply the following observation: 



Vm +1 ( z ' s )^m(z,s) ip° M (z,s). 



Vm +1 { z > s )$m{z,s) <P° m {z,s) 
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Corollary B.2. For every e > there exist Ao > and e% £ (0, e) such that the 
probability 

(B.l) P(S&t(exK,eK)) 
decays exponentially fast as K — > oo . 

Remark B.2.1. Of course, the very existence of two constants < £\ < e in (jB.lj) 
is a straightforward consequence of the LDP. The main result in the lemma and 
the corollary above is that the velocity of the random walk S^, K > 0, vanishes 
asymptotically as A — » oo. 

Proof of Lemma \B.l[ For a fixed A > 0, put Xj = Xj1L^x >A}- The integer- 
valued random variables Xj > are iid and satisfy, for s > 1 as above, E[s x ] < 
E[s x ] < oo. Moreover, by dominated convergence, EX = E[Xl| X>j 4j] — > as 

A — >• oo, and we fix A > such that EX < e/2. By the standard LDP, there exists 
a > such that 

P(5^ > (EX + e/2)K) < e~ &K for all K large enough. 

□ 
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